unzipper

What is unzipper?

The unzipper npm package is a module that provides streaming APIs for unzipping .zip files. It allows for extracting the contents of zip files, parsing zip file structures, and more, all while being memory efficient and fast.

What are unzipper's main functionalities?

Extracting zip files

This feature allows you to extract the contents of a zip file to a specified directory. The code sample demonstrates how to read a zip file as a stream and pipe it to the unzipper's Extract method, which will extract the files to the given path.

const unzipper = require('unzipper');
const fs = require('fs');

fs.createReadStream('path/to/archive.zip')
  .pipe(unzipper.Extract({ path: 'output/path' }));

Parsing zip file entries

This feature allows you to parse the contents of a zip file and work with each entry individually. The code sample shows how to read entries from a zip file and handle them based on their type, either extracting files or draining directories.

const unzipper = require('unzipper');

fs.createReadStream('path/to/archive.zip')
  .pipe(unzipper.Parse())
  .on('entry', function (entry) {
    const fileName = entry.path;
    const type = entry.type; // 'Directory' or 'File'
    if (type === 'File') {
      entry.pipe(fs.createWriteStream('output/path/' + fileName));
    } else {
      entry.autodrain();
    }
  });

Buffer-based extraction

This feature allows you to extract files from a zip file that is already loaded into a buffer. The code sample demonstrates how to open a zip file from a buffer and then extract the contents of the first file into another buffer.

const unzipper = require('unzipper');

unzipper.Open.buffer(buffer)
  .then(function (directory) {
    return directory.files[0].buffer();
  })
  .then(function (contentBuffer) {
    // Use the contentBuffer
  });

Other packages similar to unzipper

adm-zip

adm-zip is a JavaScript implementation for zip data compression for NodeJS. It provides functionalities similar to unzipper, such as reading and extracting zip files. Unlike unzipper, which is stream-based, adm-zip works with in-memory buffers, which can be less efficient for large files.

jszip

jszip is a library for creating, reading, and editing .zip files with JavaScript, with a focus on client-side use. It can be used in NodeJS as well. It offers a more comprehensive API for handling zip files compared to unzipper, including the ability to generate zip files, but it might not be as optimized for streaming large zip files.

yauzl

yauzl is another NodeJS library for reading zip files. It focuses on low-level zip file parsing and decompression, providing a minimal API. It's designed to be more memory efficient than adm-zip by using lazy parsing, but it doesn't provide the high-level convenience methods that unzipper does.

README

unzipper

This is a fork of node-unzip which has not been maintained in a while. This fork addresses the following issues:

• finish/close events are not always triggered, particular when the input stream is slower than the receivers
• Any files are buffered into memory before passing on to entry

The stucture of this fork is similar to the original, but uses Promises and inherit guarantees provided by node streams to ensure low memory footprint and guarantee finish/close events at the end of processing. The new Parser will push any parsed entries downstream if you pipe from it, while still supporting the legacy entry event as well.

Breaking changes: The new Parser will not automatically drain entries if there are no listeners or pipes in place.

Unzipper provides simple APIs similar to node-tar for parsing and extracting zip files. There are no added compiled dependencies - inflation is handled by node.js's built in zlib support.

Please note: Methods that use the Central Directory instead of parsing entire file can be found under Open

Installation

$ npm install unzipper

Quick Examples

Extract to a directory

fs.createReadStream('path/to/archive.zip')
  .pipe(unzipper.Extract({ path: 'output/path' }));

Extract emits the 'close' event once the zip's contents have been fully extracted to disk.

Parse zip file contents

Process each zip file entry or pipe entries to another stream.

Important: If you do not intend to consume an entry stream's raw data, call autodrain() to dispose of the entry's contents. Otherwise you the stream will halt.

fs.createReadStream('path/to/archive.zip')
  .pipe(unzipper.Parse())
  .on('entry', function (entry) {
    var fileName = entry.path;
    var type = entry.type; // 'Directory' or 'File'
    var size = entry.size;
    if (fileName === "this IS the file I'm looking for") {
      entry.pipe(fs.createWriteStream('output/path'));
    } else {
      entry.autodrain();
    }
  });

Parse zip by piping entries downstream

If you pipe from unzipper the downstream components will receive each entry for further processing. This allows for clean pipelines transforming zipfiles into unzipped data.

Example using stream.Transform:

fs.createReadStream('path/to/archive.zip')
  .pipe(unzipper.Parse())
  .pipe(stream.Transform({
    objectMode: true,
    transform: function(entry,e,cb) {
      var fileName = entry.path;
      var type = entry.type; // 'Directory' or 'File'
      var size = entry.size;
      if (fileName === "this IS the file I'm looking for") {
        entry.pipe(fs.createWriteStream('output/path'))
          .on('finish',cb);
      } else {
        entry.autodrain();
        cb();
      }
    }
  }
  }));

Example using etl:

fs.createReadStream('path/to/archive.zip')
  .pipe(unzipper.Parse())
  .pipe(etl.map(entry => {
    if (entry.path == "this IS the file I'm looking for")
      return entry
        .pipe(etl.toFile('output/path'))
        .promise();
    else
      entry.autodrain();
  }))
  

Parse a single file and pipe contents

unzipper.parseOne([regex]) is a convenience method that unzips only one file from the archive and pipes the contents down (not the entry itself). If no serch criteria is specified, the first file in the archive will be unzipped. Otherwise, each filename will be compared to the criteria and the first one to match will be unzipped and piped down. If no file matches then the the stream will end without any content.

Example:

fs.createReadStream('path/to/archive.zip')
  .pipe(unzipper.ParseOne())
  .pipe(fs.createReadStream('firstFile.txt'));

Buffering the content of an entry into memory

While the recommended strategy of consuming the unzipped contents is using streams, it is sometimes convenient to be able to get the full buffered contents of each file . Each entry provides a .buffer function that consumes the entry by buffering the contents into memory and returning a promise to the complete buffer.

fs.createReadStream('path/to/archive.zip')
  .pipe(unzipper.Parse())
  .pipe(etl.map(entry => {
    if (entry.path == "this IS the file I'm looking for")
      entry
        .buffer()
        .then(content => fs.writeFile('output/path',content))
    else
      entry.autodrain();
  }))

Parse.promise() syntax sugar

The parser emits finish and error events like any other stream. The parser additionally provides a promise wrapper around those two events to allow easy folding into existing Promise based structures.

Example:

fs.createReadStream('path/to/archive.zip')
  .pipe(unzipper.Parse()
  .on('entry', entry => entry.autodrain())
  .promise()
  .then( () => console.log('done'), e => console.log('error',e));

Open

Previous methods rely on the entire zipfile being received through a pipe. The Open methods load take a different approach: load the central directory first (at the end of the zipfile) and provide the ability to pick and choose which zipfiles to extract, even extracting them in parallel. The open methods return a promise on the contents of the directory, with individual files listed in an array. Each file element has the following methods:

• stream([password]) - returns a stream of the unzipped content which can be piped to any destination
• buffer([password]) - returns a promise on the buffered content of the file) If the file is encrypted you will have to supply a password to decrypt, otherwise you can leave blank.
  Unlike adm-zip the Open methods will never read the entire zipfile into buffer.

Open.file([path])

Returns a Promise to the central directory information with methods to extract individual files. start and end options are used to avoid reading the whole file.

Example:

unzipper.Open.file('path/to/archive.zip')
  .then(function(d) {
    console.log('directory',d);
    return new Promise(function(resolve,reject) {
      d.files[0].stream()
        .pipe(fs.createWriteStream('firstFile'))
        .on('error',reject)
        .on('finish',resolve)
     });
  });

Open.url([requestLibrary], [url | options])

This function will return a Promise to the central directory information from a URL point to a zipfile. Range-headers are used to avoid reading the whole file. Unzipper does not ship with a request library so you will have to provide it as the first option.

Live Example: (extracts a tiny xml file from the middle of a 500MB zipfile)

var request = require('request');
var unzipper = require('./unzip');

unzipper.Open.url(request,'http://www2.census.gov/geo/tiger/TIGER2015/ZCTA5/tl_2015_us_zcta510.zip')
  .then(function(d) {
    var file = d.files.filter(function(d) {
      return d.path === 'tl_2015_us_zcta510.shp.iso.xml';
    })[0];
    return file.buffer();
  })
  .then(function(d) {
    console.log(d.toString());
  });

This function takes a second parameter which can either be a string containing the url to request, or an options object to invoke the supplied request library with. This can be used when other request options are required, such as custom heders or authentication to a third party service.

const request = require('google-oauth-jwt').requestWithJWT();

const googleStorageOptions = {
    url: `https://www.googleapis.com/storage/v1/b/m-bucket-name/o/my-object-name`,
    qs: { alt: 'media' },
    jwt: {
        email: google.storage.credentials.client_email,
        key: google.storage.credentials.private_key,
        scopes: ['https://www.googleapis.com/auth/devstorage.read_only']
    }
});

return unzipper.Open.url(request, googleStorageOptions).then((zip) => {
    const file = zip.files.find((file) => file.path === 'my-filename');
    return file.stream().pipe(res);
});

Open.s3([aws-sdk], [params])

This function will return a Promise to the central directory information from a zipfile on S3. Range-headers are used to avoid reading the whole file. Unzipper does not ship with with the aws-sdk so you have to provide an instanciated client as first arguments. The params object requires Bucket and Key to fetch the correct file.

Example:

var unzipper = require('./unzip');
var AWS = require('aws-sdk');
var s3Client = AWS.S3(config);

unzipper.Open.s3(s3Client,{Bucket: 'unzipper', Key: 'archive.zip'})
  .then(function(d) {
    console.log('directory',d);
    return new Promise(function(resolve,reject) {
      d.files[0].stream()
        .pipe(fs.createWriteStream('firstFile'))
        .on('error',reject)
        .on('finish',resolve)
     });
  });

Licenses

See LICENCE